Gaussian sampling by local perturbations
نویسندگان
چکیده
We present a technique for exact simulation of Gaussian Markov random fields (GMRFs), which can be interpreted as locally injecting noise to each Gaussian factor independently, followed by computing the mean/mode of the perturbed GMRF. Coupled with standard iterative techniques for the solution of symmetric positive definite systems, this yields a very efficient sampling algorithm with essentially linear complexity in terms of speed and memory requirements, well suited to extremely large scale probabilistic models. Apart from synthesizing data under a Gaussian model, the proposed technique directly leads to an efficient unbiased estimator of marginal variances. Beyond Gaussian models, the proposed algorithm is also very useful for handling highly non-Gaussian continuously-valued MRFs such as those arising in statistical image modeling or in the first layer of deep belief networks describing real-valued data, where the non-quadratic potentials coupling different sites can be represented as finite or infinite mixtures of Gaussians with the help of local or distributed latent mixture assignment variables. The Bayesian treatment of such models most naturally involves a block Gibbs sampler which alternately draws samples of the conditionally independent latent mixture assignments and the conditionally multivariate Gaussian continuous vector and we show that it can directly benefit from the proposed methods.
منابع مشابه
A Novel Approach for Determining Source-Receptor Relationships in Model Simulations: A Case Study of Black Carbon Transport in Northern Hemisphere Winter
A Gaussian process emulator is applied to quantify the contributions of local and remote emissions of black carbon to its concentrations in different regions using a Latin hypercube sampling strategy for emission perturbations in the offline version of the Community Atmosphere Model Version 5.1 (CAM5) simulations. The source–receptor relationships are computed based on simulations constrained b...
متن کاملMixed Mode Crack Propagation of Zirconia/Nickel Functionally Graded Materials
Zirconia-nickel functionally graded materials were obtained by powder metallurgy technique. The microstructure, residual stress, fracture toughness and Vickers hardness were investigated. Mixed-mode fracture response of YSZ /Ni functionally graded materials was examined utilizing the three point bending test and finite element method (Cosmos/M 2.7). The results show that the stress intensity fac...
متن کاملA Bayesian Prediction using the Elliptical and the Skew Gaussian Processes
A Bayesian Prediction using the Elliptical Processes (EP) and the Skew Gaussian Processes (SGP) is proposed, motivated by a Bayesian model for heavy, light tailed or skewed real data. We define weak third order stationary for the Skew Gaussian Processes. Sometimes the family of distributions have dimensional coherency (consistency) property which is important for prediction. We use a Markov Cha...
متن کاملUsing Perturbed Underdamped Langevin Dynamics to Efficiently Sample from Probability Distributions
In this paper we introduce and analyse Langevin samplers that consist of perturbations of the standard underdamped Langevin dynamics. The perturbed dynamics is such that its invariant measure is the same as that of the unperturbed dynamics. We show that appropriate choices of the perturbations can lead to samplers that have improved properties, at least in terms of reducing the asymptotic varia...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010